Update smoke test latest tool versions#10924
Open
dd-octo-sts[bot] wants to merge 1 commit intomasterfrom
Open
Conversation
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
BenchmarksStartupParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 62 metrics, 9 unstable metrics. Startup time reports for petclinicgantt
title petclinic - global startup overhead: candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.06 s) : 0, 1059567
Total [baseline] (11.055 s) : 0, 11054803
Agent [candidate] (1.059 s) : 0, 1059098
Total [candidate] (11.053 s) : 0, 11052968
section appsec
Agent [baseline] (1.247 s) : 0, 1247359
Total [baseline] (11.191 s) : 0, 11190957
Agent [candidate] (1.251 s) : 0, 1250793
Total [candidate] (11.092 s) : 0, 11091804
section iast
Agent [baseline] (1.229 s) : 0, 1229327
Total [baseline] (11.256 s) : 0, 11256122
Agent [candidate] (1.231 s) : 0, 1230610
Total [candidate] (11.342 s) : 0, 11341900
section profiling
Agent [baseline] (1.193 s) : 0, 1192723
Total [baseline] (10.999 s) : 0, 10999495
Agent [candidate] (1.185 s) : 0, 1185177
Total [candidate] (10.971 s) : 0, 10970719
gantt
title petclinic - break down per module: candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.197 ms) : 0, 1197
crashtracking [candidate] (1.215 ms) : 0, 1215
BytebuddyAgent [baseline] (631.194 ms) : 0, 631194
BytebuddyAgent [candidate] (630.906 ms) : 0, 630906
AgentMeter [baseline] (29.475 ms) : 0, 29475
AgentMeter [candidate] (29.331 ms) : 0, 29331
GlobalTracer [baseline] (257.258 ms) : 0, 257258
GlobalTracer [candidate] (256.715 ms) : 0, 256715
AppSec [baseline] (31.692 ms) : 0, 31692
AppSec [candidate] (31.592 ms) : 0, 31592
Debugger [baseline] (60.543 ms) : 0, 60543
Debugger [candidate] (60.318 ms) : 0, 60318
Remote Config [baseline] (610.848 µs) : 0, 611
Remote Config [candidate] (592.628 µs) : 0, 593
Telemetry [baseline] (8.015 ms) : 0, 8015
Telemetry [candidate] (7.998 ms) : 0, 7998
Flare Poller [baseline] (3.504 ms) : 0, 3504
Flare Poller [candidate] (4.285 ms) : 0, 4285
section appsec
crashtracking [baseline] (1.194 ms) : 0, 1194
crashtracking [candidate] (1.222 ms) : 0, 1222
BytebuddyAgent [baseline] (657.888 ms) : 0, 657888
BytebuddyAgent [candidate] (661.051 ms) : 0, 661051
AgentMeter [baseline] (12.163 ms) : 0, 12163
AgentMeter [candidate] (12.14 ms) : 0, 12140
GlobalTracer [baseline] (258.392 ms) : 0, 258392
GlobalTracer [candidate] (258.606 ms) : 0, 258606
IAST [baseline] (24.277 ms) : 0, 24277
IAST [candidate] (24.252 ms) : 0, 24252
AppSec [baseline] (178.096 ms) : 0, 178096
AppSec [candidate] (177.983 ms) : 0, 177983
Debugger [baseline] (66.302 ms) : 0, 66302
Debugger [candidate] (66.483 ms) : 0, 66483
Remote Config [baseline] (628.658 µs) : 0, 629
Remote Config [candidate] (624.75 µs) : 0, 625
Telemetry [baseline] (8.349 ms) : 0, 8349
Telemetry [candidate] (8.43 ms) : 0, 8430
Flare Poller [baseline] (3.656 ms) : 0, 3656
Flare Poller [candidate] (3.644 ms) : 0, 3644
section iast
crashtracking [baseline] (1.19 ms) : 0, 1190
crashtracking [candidate] (1.192 ms) : 0, 1192
BytebuddyAgent [baseline] (796.711 ms) : 0, 796711
BytebuddyAgent [candidate] (798.669 ms) : 0, 798669
AgentMeter [baseline] (11.475 ms) : 0, 11475
AgentMeter [candidate] (11.455 ms) : 0, 11455
GlobalTracer [baseline] (247.67 ms) : 0, 247670
GlobalTracer [candidate] (247.866 ms) : 0, 247866
IAST [baseline] (25.47 ms) : 0, 25470
IAST [candidate] (25.34 ms) : 0, 25340
AppSec [baseline] (26.666 ms) : 0, 26666
AppSec [candidate] (26.483 ms) : 0, 26483
Debugger [baseline] (70.854 ms) : 0, 70854
Debugger [candidate] (69.728 ms) : 0, 69728
Remote Config [baseline] (530.306 µs) : 0, 530
Remote Config [candidate] (526.641 µs) : 0, 527
Telemetry [baseline] (9.256 ms) : 0, 9256
Telemetry [candidate] (9.668 ms) : 0, 9668
Flare Poller [baseline] (3.397 ms) : 0, 3397
Flare Poller [candidate] (3.497 ms) : 0, 3497
section profiling
crashtracking [baseline] (1.185 ms) : 0, 1185
crashtracking [candidate] (1.173 ms) : 0, 1173
BytebuddyAgent [baseline] (689.172 ms) : 0, 689172
BytebuddyAgent [candidate] (683.943 ms) : 0, 683943
AgentMeter [baseline] (9.073 ms) : 0, 9073
AgentMeter [candidate] (9.067 ms) : 0, 9067
GlobalTracer [baseline] (217.372 ms) : 0, 217372
GlobalTracer [candidate] (215.958 ms) : 0, 215958
AppSec [baseline] (32.479 ms) : 0, 32479
AppSec [candidate] (32.126 ms) : 0, 32126
Debugger [baseline] (66.268 ms) : 0, 66268
Debugger [candidate] (66.154 ms) : 0, 66154
Remote Config [baseline] (561.962 µs) : 0, 562
Remote Config [candidate] (553.144 µs) : 0, 553
Telemetry [baseline] (7.726 ms) : 0, 7726
Telemetry [candidate] (7.675 ms) : 0, 7675
Flare Poller [baseline] (3.464 ms) : 0, 3464
Flare Poller [candidate] (3.451 ms) : 0, 3451
ProfilingAgent [baseline] (93.992 ms) : 0, 93992
ProfilingAgent [candidate] (93.997 ms) : 0, 93997
Profiling [baseline] (94.553 ms) : 0, 94553
Profiling [candidate] (94.563 ms) : 0, 94563
Startup time reports for insecure-bankgantt
title insecure-bank - global startup overhead: candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
dateFormat X
axisFormat %s
section tracing
Agent [baseline] (1.055 s) : 0, 1055007
Total [baseline] (8.877 s) : 0, 8876949
Agent [candidate] (1.064 s) : 0, 1063698
Total [candidate] (8.843 s) : 0, 8842509
section iast
Agent [baseline] (1.247 s) : 0, 1247270
Total [baseline] (9.582 s) : 0, 9581963
Agent [candidate] (1.227 s) : 0, 1226688
Total [candidate] (9.576 s) : 0, 9575844
gantt
title insecure-bank - break down per module: candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
dateFormat X
axisFormat %s
section tracing
crashtracking [baseline] (1.228 ms) : 0, 1228
crashtracking [candidate] (1.226 ms) : 0, 1226
BytebuddyAgent [baseline] (627.822 ms) : 0, 627822
BytebuddyAgent [candidate] (633.812 ms) : 0, 633812
AgentMeter [baseline] (29.339 ms) : 0, 29339
AgentMeter [candidate] (29.645 ms) : 0, 29645
GlobalTracer [baseline] (256.552 ms) : 0, 256552
GlobalTracer [candidate] (258.511 ms) : 0, 258511
AppSec [baseline] (31.605 ms) : 0, 31605
AppSec [candidate] (31.966 ms) : 0, 31966
Debugger [baseline] (59.59 ms) : 0, 59590
Debugger [candidate] (59.997 ms) : 0, 59997
Remote Config [baseline] (588.472 µs) : 0, 588
Remote Config [candidate] (605.711 µs) : 0, 606
Telemetry [baseline] (8.703 ms) : 0, 8703
Telemetry [candidate] (8.05 ms) : 0, 8050
Flare Poller [baseline] (3.485 ms) : 0, 3485
Flare Poller [candidate] (3.572 ms) : 0, 3572
section iast
crashtracking [baseline] (1.216 ms) : 0, 1216
crashtracking [candidate] (1.202 ms) : 0, 1202
BytebuddyAgent [baseline] (810.318 ms) : 0, 810318
BytebuddyAgent [candidate] (795.687 ms) : 0, 795687
AgentMeter [baseline] (12.018 ms) : 0, 12018
AgentMeter [candidate] (11.426 ms) : 0, 11426
GlobalTracer [baseline] (250.611 ms) : 0, 250611
GlobalTracer [candidate] (247.788 ms) : 0, 247788
AppSec [baseline] (27.067 ms) : 0, 27067
AppSec [candidate] (27.42 ms) : 0, 27420
Debugger [baseline] (69.941 ms) : 0, 69941
Debugger [candidate] (68.018 ms) : 0, 68018
Remote Config [baseline] (534.221 µs) : 0, 534
Remote Config [candidate] (527.459 µs) : 0, 527
Telemetry [baseline] (9.754 ms) : 0, 9754
Telemetry [candidate] (9.668 ms) : 0, 9668
Flare Poller [baseline] (3.529 ms) : 0, 3529
Flare Poller [candidate] (3.469 ms) : 0, 3469
IAST [baseline] (25.865 ms) : 0, 25865
IAST [candidate] (25.428 ms) : 0, 25428
LoadParameters
See matching parameters
SummaryFound 1 performance improvements and 1 performance regressions! Performance is the same for 17 metrics, 17 unstable metrics.
Request duration reports for petclinicgantt
title petclinic - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
dateFormat X
axisFormat %s
section baseline
no_agent (17.15 ms) : 16980, 17320
. : milestone, 17150,
appsec (19.033 ms) : 18845, 19220
. : milestone, 19033,
code_origins (17.959 ms) : 17778, 18139
. : milestone, 17959,
iast (17.655 ms) : 17481, 17830
. : milestone, 17655,
profiling (19.581 ms) : 19381, 19780
. : milestone, 19581,
tracing (17.624 ms) : 17449, 17799
. : milestone, 17624,
section candidate
no_agent (19.262 ms) : 19062, 19463
. : milestone, 19262,
appsec (18.639 ms) : 18449, 18830
. : milestone, 18639,
code_origins (17.575 ms) : 17397, 17754
. : milestone, 17575,
iast (17.731 ms) : 17557, 17906
. : milestone, 17731,
profiling (19.762 ms) : 19559, 19964
. : milestone, 19762,
tracing (17.493 ms) : 17319, 17668
. : milestone, 17493,
Request duration reports for insecure-bankgantt
title insecure-bank - request duration [CI 0.99] : candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
dateFormat X
axisFormat %s
section baseline
no_agent (1.185 ms) : 1174, 1197
. : milestone, 1185,
iast (3.189 ms) : 3146, 3232
. : milestone, 3189,
iast_FULL (5.826 ms) : 5767, 5885
. : milestone, 5826,
iast_GLOBAL (3.517 ms) : 3460, 3574
. : milestone, 3517,
profiling (2.406 ms) : 2381, 2430
. : milestone, 2406,
tracing (1.8 ms) : 1785, 1815
. : milestone, 1800,
section candidate
no_agent (1.188 ms) : 1176, 1199
. : milestone, 1188,
iast (3.249 ms) : 3204, 3294
. : milestone, 3249,
iast_FULL (5.806 ms) : 5747, 5866
. : milestone, 5806,
iast_GLOBAL (3.499 ms) : 3443, 3554
. : milestone, 3499,
profiling (2.111 ms) : 2091, 2132
. : milestone, 2111,
tracing (1.771 ms) : 1756, 1786
. : milestone, 1771,
DacapoParameters
See matching parameters
SummaryFound 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics. Execution time for tomcatgantt
title tomcat - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
dateFormat X
axisFormat %s
section baseline
no_agent (1.476 ms) : 1464, 1487
. : milestone, 1476,
appsec (3.772 ms) : 3554, 3989
. : milestone, 3772,
iast (2.266 ms) : 2196, 2335
. : milestone, 2266,
iast_GLOBAL (2.304 ms) : 2234, 2374
. : milestone, 2304,
profiling (2.087 ms) : 2032, 2142
. : milestone, 2087,
tracing (2.06 ms) : 2007, 2114
. : milestone, 2060,
section candidate
no_agent (1.48 ms) : 1468, 1491
. : milestone, 1480,
appsec (3.813 ms) : 3591, 4035
. : milestone, 3813,
iast (2.269 ms) : 2199, 2338
. : milestone, 2269,
iast_GLOBAL (2.304 ms) : 2235, 2374
. : milestone, 2304,
profiling (2.112 ms) : 2055, 2169
. : milestone, 2112,
tracing (2.069 ms) : 2016, 2123
. : milestone, 2069,
Execution time for biojavagantt
title biojava - execution time [CI 0.99] : candidate=1.61.0-SNAPSHOT~79de7e5bb64, baseline=1.61.0-SNAPSHOT~c00f676bb9
dateFormat X
axisFormat %s
section baseline
no_agent (14.839 s) : 14839000, 14839000
. : milestone, 14839000,
appsec (14.859 s) : 14859000, 14859000
. : milestone, 14859000,
iast (18.088 s) : 18088000, 18088000
. : milestone, 18088000,
iast_GLOBAL (18.051 s) : 18051000, 18051000
. : milestone, 18051000,
profiling (14.944 s) : 14944000, 14944000
. : milestone, 14944000,
tracing (14.75 s) : 14750000, 14750000
. : milestone, 14750000,
section candidate
no_agent (14.898 s) : 14898000, 14898000
. : milestone, 14898000,
appsec (14.596 s) : 14596000, 14596000
. : milestone, 14596000,
iast (18.295 s) : 18295000, 18295000
. : milestone, 18295000,
iast_GLOBAL (17.852 s) : 17852000, 17852000
. : milestone, 17852000,
profiling (15.056 s) : 15056000, 15056000
. : milestone, 15056000,
tracing (14.89 s) : 14890000, 14890000
. : milestone, 14890000,
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What Does This Do
This PR updates the pinned "latest" tool versions used by CI Visibility smoke tests:
Motivation
Keep smoke tests running against the latest stable versions of build tools.
Contributor Checklist